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ENVIRONMENT-BASED BOOKMARK MEDIA 

BACKGROUND 

The present invention relates to using environment-based bookmark media. 

The Internet is a collection of integrated networks spanning the world and includes 
hundreds of thousands of online environments, such as a web sites and chat rooms. These 
environments are collectively referred to as the World Wide Web (WWW) and provide 
electronic "content", including text, graphics, audio and video. The content is often defined 
by a document, referred to as a web page, that conforms to the HyperText Markup Language 
(HTML). HTML is a formatting language that defines a number of tags for formatting the 
content of the web page and allows embedding references to other destinations within the 
WWW. Each destination on the WWW is uniquely identified by a global address referred to 
as a Uniform Resource Locator (URL). The URL identifies the particular server storing the 
media as well as the media's location within the server. 

There are several software applications, called web browsers, by which a user can 
easily navigate the World Wide Web, access the online environments and view the electronic 
content. Modern web browsers can display graphics as well as text and can present 
multimedia information including sound and video. Using a web browser, a user can jump 
from one destination to another by selecting one of the embedded references, also referred to 
as links. When the user views media from one destination and selects one of the embedded 
references, the web browser downloads media from the destination identified by the link and 
presents the media to the user. In this manner, the user navigates the World Wide Web, 
jumping from one destination to another 

Conventional web browsers support a "bookmarking" feature that lets the user save 
the URLs of frequently accessed destinations within the World Wide Web. The user can 
easily access the destinations at a later time by simply viewing his or her bookmarked URLs 
and selecting the desired destination. Modern bookmark management software applications 
allow the user to organize and manage the collection of bookmarks. 
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SUMMARY OF THE INVENTION 

In general, the invention provides a method and apparatus, including a computer 
program apparatus, implementing techniques to provide an up-to-date multimedia preview of 
a user's favorite destinations within a network environment. 
5 According to one aspect, the techniques are directed to a method in which a client 

device stores a set of references to external destinations in a network environment and a 
second set of references that identifies a remote bookmark media object for each destination. 
The bookmark media objects are retrieved and presented to a user for selection. The network 
destination corresponding to the selected bookmark media object is accessed as a function of 
10 its respective stored reference. The bookmark media object can be a thumbnail, a video 
stream, an audio stream or any combination thereof or other suitable media. 

In another aspect, the invention is directed to a system in which a server within an 
O online environment is configured to store a set of bookmark media objects. The bookmark 

m media objects can be thumbnails of corresponding web pages, audio streams, video streams 
'ijl5 or any combination thereof that provides a representation of a destination. A client device is 
O communicatively coupled to the server and is configured to store references to the network 

p destinations and references to the corresponding bookmark media objects. A web browser 
L executing in an operating environment provided by the client device is configured to present 

ffl the bookmark media objects to a user for selection. Based on the selection, the web browser 
r20 accesses the corresponding network destination. Each remote bookmark media object is 
y updated as a function of a current state of the corresponding network destination, user 

information or general conditions of the computing environment. 

According to yet another aspect, the invention is a computer-readable medium having 
instructions stored thereon to cause a programmable processor to store on a client device a 
25 set of references to external destinations in a network environment, each destination having 
an associated bookmark media object. The instructions further cause the programmable 
processor to retrieve and present the bookmark media objects to a user for selection and 
access the network destination corresponding to the selected media object. 

The invention offers several advantages. For example, the bookmark media objects 
30 provide a visual or audio hint as to the state of a destination without requiring the user to 

access the destination. This is especially advantageous when the user is navigating a three- 
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dimensional network environment. Furthermore, unlike conventional client-based 
bookmarks, the environment-based bookmark media objects are advantages in that the 
associated destinations within the network environment can change locations without 
rendering the user's bookmarks useless. 

Various embodiments of the invention are set forth in the accompanying drawings 
and the description below. Other features and advantages of the invention will become 
apparent from the description, the drawings, and the claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram illustrating a networked system in which client devices 
and online environments cooperate to present user dynamic, multimedia previews of 
corresponding network destinations. 

Figure 2 is a block diagram further illustrating the components of the invention. 

Figure 3 is a flowchart illustrating an example process of providing multimedia 
previews of network destinations. 

Figure 4 illustrates a window presented by a web browser that displays a matrix of 
graphic thumbnails corresponding to favorite network destinations, 

Figures 5 and 6 illustrate additional examples of windows presented by a web 
browser according to the invention. 

Figure 7 is a block diagram illustrates one embodiment of a computer suitable for 
implementing the various embodiments of the invention. 

DETAILED DESCRIPTION 

Figure 1 is a block diagram illustrating a system 2 in which environment-based 
bookmark media objects are used to provide multimedia previews of network destinations. 
Generally, system 2 includes a number of client devices 4 that are coupled to online 
environments 8 via network 18. Each environment 8 represents an online environment that is 
remotely accessible via a web browser, such as a web site, a chat room and, as illustrated 
below, a three-dimensional virtual world. Each environment 8 includes one or more 
destinations. Examples of destinations within online environments 8 include individual web 
pages within a web site, particular online chat rooms and entry points to three-dimensional 

worlds. Each environment 8 generates and maintains a corresponding bookmark media 
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object for each destination. As explained in detail below, client devices 4 use these 
environment-based media objects to support improved bookmarking features. More 
specifically, when the users wish to access favorite destinations, client devices 4 present the 
media objects to the users for selection, thereby providing a preview of each destination. 
5 The environment-based bookmark media objects provide dynamic representations of 

the destinations. For example, a bookmark media object can be a "thumbnail," which is a 
miniature display of the corresponding destination. The thumbnails allow the user to see the 
general layout of the destination without accessing the destination. The bookmark media 
objects may also include audio and video media. For example, a bookmark object may be an 
10 audio stream, a video stream, or a combination thereof The bookmark media objects 

provide a multimedia preview of the corresponding destinations such that the user to can 
better choose a target destination than with conventional bookmarks. 
ni Figure 2 is a block diagram further illustrating the details of the invention. Web 

jfj browser 10, such as Internet Explorer™ from Microsoft™ Corporation of Redmond, 
=fll5 Washington, executes in an operating environment provided by client device 4 and allows a 
E user to remotely access the destination provided by environments 8. Client devices 4 

\n represent general purpose computing systems suitable for interacting with environments 8 via 
* network 18. One example of a suitable client device 4 is a personal computer. In addition, 

^ each client device 4 can be a laptop computer, a handheld computer, a personal digital 
H20 assistant (PDA), such as a Palm™ organizer from Palm Inc. of Santa Clara, California, or a 
q network-enabled cellular telephone. Network 18 represents any communication network, 
— such as a packet-based digital network like the Internet. 

Environment 8 provides one or more destination 22 and corresponding bookmark 
media objects 24. Environment 8 represents any online environment remotely accessible via 
25 web browser 10, such as web sites, chat rooms and, as illustrated below, three-dimensional 
virtual worlds. As such, environment 8 typically includes one or more servers (not shown), 
such as a web server executing web server software. In addition, environment 8 may include 
one or more database servers, such as SQL Server from Microsoft Corporation or the 
Oracle™ database engine from Oracle Corporation. 
30 To facilitate the unique bookmarking features, web browser 10 maintains two sets of 

references, such as URL addresses, that uniquely identify favorite destinations and their 
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corresponding media objects. More specifically, web browser 10 maintains destination 
references 26 and media object references 28. Destination references 26 identify the 
bookmarked destinations 22 within environment 8. Each destination reference 26 is paired 
with a media object reference 28 that uniquely identifies the corresponding bookmark media 
5 objects 24. The pair of references allow web browser 10 to present the bookmark media 
objects 24 to the user and access one of the destination 22 as a function of the user's 
selection. Alternatively, the location of each bookmark media object 24 can be a function of 
the location of the corresponding destinations 22. For example, a web page located at 
http://www.adobe.com/paRel.html can have a corresponding bookmark media object 24 
10 located at http://www.adobe.com/pagel .obj . In this manner, web browser 10 need not store 
two separate references. 

Plug-in 14 is a software module that provides additional features to web browser 10, 
q thereby allowing web browser 10 to support the improved bookmarking capabilities. For 
;~ example, plug-in 14 allows web browser 10 to present the bookmark media objects 24 when 
J35 the user views his or her bookmarked destinations. Web browser 10 traverses the media 
□ object references 28 and checks the status of each bookmark media object 24 stored on 
environment 8. Web browser 10 retrieves a new copy of any bookmark object 24 that is 
accessible and that has been updated by environment 8. When the user wishes to view his or 
m her favorite destinations, i.e., the bookmarked destination, web browser 1 0 presents 
%|o bookmark media objects 22 identified by media object references 28. Depending on the 
O actual bookmark media objects 24 identified, web browser 10 may present a variety of 

multimedia outputs including graphic thumbnails, audio or video content, or any combination 
thereof 

Figure 3 is a flow chart illustrating one implementation of a process 40 by which 
25 client device 4 and environment 8 cooperate to present the user with dynamic, multimedia 
previews of his or her favorite destinations. Environment 42 generates bookmark media 
objects 24 for each destination 22 (step 42). This task may be automated such that, for 
example, a thumbnail is generated for each web page. Alternatively, a publisher that is 
responsible for creating the content of environment 8 may manually create each bookmark 
30 media object 24 using conventional publishing tools. 
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Next, environment 8, or the publisher, updates bookmark media objects 24 such that 
each bookmark media object 24 reflects a current state of its corresponding destination 22 
(step 44). For example, environment 8 can automatically update the media objects 24 as a 
function of "environment-determined" conditions, such as current loading conditions at 
5 environment 8 and changes in content provided by environment 8. In addition, environment 
8 can update the bookmark media objects 24 based on information received from client 
devices 4, such as user identification or other cached information. Also, environments 8 can 
update the media objects based on general computing conditions, such as a current bandwidth 
of network 18. In this fashion, each bookmark media object dynamically reflects the 
1 0 respective network destination and its accessibility. 

When the user designates a particular destination 22 for bookmarking, web browser 
10 executing on client device 4 stores a destination reference 26 as well as a corresponding 
n media object reference 28 (step 46). At a later time when the user wishes to revisit a favorite 
71 destination, web browser 48 retrieves and presents the bookmark media objects 22 that are 
t0l5 identified by media object references 28 (48). Web browser 10 can retrieve the bookmark 
H media objects 24 upon first execution or when directed by the user. In addition, web browser 
'if 10 need only retrieve those bookmark media objects 24 that have changed relative to any 

locally cached objects. In one configuration, web browser 10 presents the bookmark media 
m objects in matrix form for selection by the user. After the user has selected a bookmark 
\2o media object 24, web browser 10 accesses the corresponding destination 22 as a function of 
O the corresponding destination reference 26 (step 50). 

Figure 4 illustrates an example bookmark window 50 presented by web browser 10. 
Window 10 displays a matrix of thumbnails 52. In the illustrated example, each thumbnail is 
an up-to-date miniature display of a web page at the corresponding destination that reflects 
25 the current state of the web page. When the user selects one of the thumbnails 52, web 
browser 10 accesses the corresponding destination and retrieves the complete web page. 

Figure 5 illustrates another example of a window 60 presented by web browser 10. 
Window 60 includes a view screen 62 for displaying content from environment 8. Current 
bookmark object 64 displays the bookmark media object for the current destination being 
30 accessed. As illustrated in Figure 5, the user has not yet accessed a particular destination 22. 
Therefore, view screen 62 is blank and current bookmark media object 64 displays a default 
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graphic image. Bookmark window 66 displays a number of bookmark media objects 66 that 
the user can select. Each bookmark media object 66 is retrieved from an environment 8 and 
displayed to the user in order to present an up-to-date multimedia preview of the 
corresponding destination. Bookmark window 66 displays the default graphic image for any 
5 destinations that are currently inaccessible. 

Figure 6 illustrates a window 70 presented by web browser 10 after the user has 
selected a particular destination 22. View screen 62 displays content received from the 
destination 22, which in this example is a three-dimensional world. Current bookmark object 
64 displays a graphic thumbnail of the current destination. Using navigation bar 72, the user 
10 can move in various directions and traverse the 3D world. In order to bookmark the current 
destination, the user can drag current bookmark object 64 into bookmark window 66 using a 
conventional pointing mechanism, such as a mouse. 
H Figure 7 illustrates a programmable computing system (system) 100 that provides an 

operating environment suitable for use as a client device 4 or as a server within environment 

'"If ® 
UJ15 8. System 100 includes a processor 112 that in one embodiment belongs to the PENTIUM 

]h family of microprocessors manufactured by the Intel Corporation of Santa Clara, California. 

However, the invention can be implemented on computers based upon other 

(R) 

=: microprocessors, such as the MIPS family of microprocessors from the Silicon Graphics 

i™! (g) 

Sip Corporation, the POWERPC family of microprocessors from both the Motorola 
^20 Corporation and the IBM Corporation, the PRECISION ARCHITECTURE® family of 
D microprocessors from the Hewlett-Packard Company, the SPARC family of 

5™",; (g) 

^ microprocessors from the Sun Microsystems Corporation, or the ALPHA family of 

microprocessors from the Compaq Computer Corporation. In various configurations, system 
100 represents any server, personal computer, laptop or even a battery-powered, pocket- 

25 sized, mobile computer known as a hand-held PC or personal digital assistant (PDA), 

System 100 includes system memory 1 13, including read only memory (ROM) 1 14 
and random access memory (RAM) 115, which is connected to the processor 1 12 by a 
system data/address bus 116. ROM 114 represents any device that is primarily read-only 
including electrically erasable programmable read-only memory (EEPROM), flash memory, 

30 etc. RAM 1 15 represents any random access memory such as Synchronous Dynamic 
Random Access Memory. 
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Within the system 100, input/output bus 1 18 is connected to the data/address bus 1 16 
via bus controller 1 19. In one embodiment, input/output bus 1 18 is implemented as a 
standard Peripheral Component Interconnect (PCI) bus. The bus controller 119 examines all 
signals from the processor 1 12 to route the signals to the appropriate bus. Signals between 
the processor 112 and the system memory 1 13 are merely passed through the bus controller 

119. However, signals from the processor 112 intended for devices other than system 
memory 1 13 are routed onto the input/output bus 118. 

Various devices are connected to the input/output bus 118 including hard disk drive 

120, floppy drive 121 that is used to read floppy disk 151, and optical drive 122, such as a 
CD-ROM drive that is used to read an optical disk 152. The video display 124 or other kind 
of display device is connected to the input/output bus 1 18 via a video adapter 125. 

Users enter commands and information into the system 100 by using a keyboard 140 
and/or pointing device, such as a mouse 142, which are connected to bus 1 18 via input/output 
ports 128. Other types of pointing devices (not shown) include track pads, track balls, 
joysticks, data gloves, head trackers, and other devices suitable for positioning a cursor on 
the video display 124. 

System 100 also includes a modem 129. Although illustrated as external to the system 
100, those of ordinary skill in the art will quickly recognize that the modem 129 may also be 
internal to the system 100. The modem 129 is typically used to communicate over wide area 
networks (not shown), such as the global Internet. Modem 129 may be connected to a 
network using either a wired or wireless connection. 

Software applications 136 and data are typically stored via one of the memory storage 
devices, which may include the hard disk 120, floppy disk 151, CD-ROM 152 and are copied 
to RAM 1 15 for execution. In one embodiment, however, software applications 136 are 
stored in ROM 114 and are copied to RAM 1 15 for execution or are executed directly from 
ROM 114. 

In general, the operating system 135 executes software applications 136 and carries 
out instructions issued by the user. For example, when the user wants to load a software 
application 136, the operating system 135 interprets the instruction and causes the processor 
1 12 to load software application 136 into RAM 115 from either the hard disk 120 or the 
optical disk 152. Once one of the software applications 136 is loaded into the RAM 115, it 
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can be used by the processor 112. In case of large software applications 136, processor 112 
loads various portions of program modules into RAM 115 as needed. 

The Basic Input/Output System (BIOS) 117 for the system 100 is a set of basic 
executable routines that have conventionally helped to transfer information between the 
5 computing resources within the system 100. Operating system 135 or other software 
applications 136 use these low-level service routines. In one embodiment system 100 

includes a registry (not shown) that is a system database that holds configuration information 

® 

for system 100. For example, the Windows operating system by Microsoft Corporation of 

Redmond, Washington, maintains the registry in two hidden files, called USER.DAT and 
10 SYSTEM.DAT, located on a permanent storage device such as an internal disk. 

Various embodiments have been described for using environment-based bookmark 

media objects to provide up-to-date multimedia previews of favorite destinations. The 
= invention has been described in terms of particular embodiments. Other embodiments are 

within the scope of the following claims. 



?.yi 5 What is claimed is : 

? lj 1 1. A method comprising: 

s: 2 storing on a client device a set of references to external destinations in a 

m 3 network environment, each destination having an associated bookmark media object; 

?Z 4 presenting the bookmark media objects to a user for selection; and 

O 5 accessing the network destination corresponding to the selected bookmark 

?as? 6 media object. 

1 2. The method of claim 1 further comprising storing on the client device a set of 

2 references to the media objects. 

1 3. The method of claim 1 , wherein accessing the network destination comprises 

2 retrieving a web page corresponding to the selected media object. 

1 4. The method of claim 1 , wherein accessing the network destination comprises 

2 retrieving a three -dimensional environment corresponding to the selected media 

3 object. 

9 
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1 5. The method of claim 1 , wherein presenting the bookmark media objects comprises 

2 retrieving the bookmark media objects from one or more hosts. 

1 6. The method of claim 1 wherein presenting the bookmark media objects comprises 

2 displaying at least one thumbnail. 

1 7. The method of claim 1, wherein presenting the bookmark media objects comprises 

2 displaying a matrix of bookmark media objects. 

1 8. The method of claim 1 wherein presenting the bookmark media object comprises 

2 displaying a stream of video. 

1 9. The method of claim 1 wherein displaying the bookmark media objects comprises 

2 outputting audible sounds. 

1 1 0. The method of claim 1 and further including: 

2 verifying a status of each bookmark media object; and 

3 presenting a default bookmark media object when the status indicates the 

4 corresponding bookmark media object is not available. 

1 11. The method of claim 1 , wherein each bookmark media object represents a current 

2 state of the corresponding network destination. 

1 12. The method of claim 1 , wherein each bookmark media object represents an entry 

2 point into three-dimensional content defined by the web pages. 

1 13. A method comprising : 

2 generating a set of bookmark media object, each bookmark media object 

3 corresponding to a network destination within a computing environment; 

4 storing the bookmark media objects on one or more servers within the 

5 computing environment; and 

6 updating the bookmark media objects as a function of a state of the computing 

7 environment. 
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1 14. The method of claim 1 3, wherein updating the bookmark media object comprises 

2 updating the bookmark media object as a function of a current state of the 

3 corresponding network destination. 

1 15. The method of claim 13, wherein updating the bookmark media object comprises 

2 updating the bookmark media object as a function of the information received from a 

3 remote user. 

1 1 6. The method of claim 1 3, wherein the set of bookmark media objects are generated by 

2 a server within the computing environment, and further wherein updating the 

3 bookmark media object comprises updating the bookmark media object as a function 

4 of host-determined conditions. 

1 17. The method of claim 13, wherein updating the bookmark media object comprises 

2 updating the bookmark media object when content of the network destination is 

3 changed. 

1 18. The method of claim 13, wherein generating the bookmark media object includes 

2 generating a thumbnail. 

1 19. The method of claim 1 3 , wherein updating the bookmark media obj ect includes 

2 generating a video stream. 

1 20. The method of claim 13, wherein updating the bookmark media object includes 

2 generating an audio stream. 

1 21 . The method of claim 1 3 further comprising communicating the bookmark media 

2 objects to a client device for display to a user. 

1 22. A computer-readable medium having instructions stored thereon to cause a 

2 programmable processor to : 

3 store on a client device a set of references to external destinations in a network 

4 environment, each destination having an associated bookmark media object; 

5 present the bookmark media objects to a user for selection; and 
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6 access the network destination corresponding to the selected bookmark media 

7 object. 

1 23. The computer-readable medium of claim 22, wherein the instructions cause the 

2 programmable processor to store on the client device a set of references to the 

3 bookmark media obj ect s . 

1 24. The computer-readable medium of claim 22, wherein the instructions cause the 

2 programmable processor to retrieve a web page corresponding to the selected 

3 bookmark media obj ect. 

1 25. The computer-readable medium of claim 22, wherein the instructions cause the 

2 programmable processor to retrieve a three-dimensional environment corresponding 

3 to the selected bookmark media object. 

1 26. The computer-readable medium of claim 22, wherein the instructions cause the 

2 programmable processor to present the bookmark media objects by displaying at least 

3 one thumbnail. 

1 27. The computer-readable medium of claim 22, wherein the instructions cause the 

2 programmable processor to present the bookmark media object by displaying a 

3 stream of video. 

1 28. The computer-readable medium of claim 22, wherein the instructions cause the 

2 programmable processor to output audible sounds in response to at least one audio 

3 signal 

1 29. The computer-readable medium of claim 22, wherein the instructions cause the 

2 programmable processor to verify a status of each bookmark media object; and 

3 present a default bookmark media object when the status indicates the corresponding 

4 bookmark media object is not available. 

1 30. The computer-readable medium of claim 22, wherein each bookmark media object 

2 represents a current state of the corresponding network destination. 
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1 31. A system comprising: 

2 a server configured to store a set of bookmark media objects, wherein each 

3 bookmark media object corresponds to a destination within a network environment; 

4 a client device communicatively coupled to the server and configured to store 

5 references to the network destinations; and 

6 a web browser executing in an operating environment provided by the client 

7 device, wherein the browser is configured to present the bookmark media objects to a 

8 user for selection as a function of the references and to access the network destination 

9 corresponding to the selected bookmark media object. 

1 32. The system of claim 3 1 , wherein at least one of the bookmark media objects 

2 comprises a thumbnail. 

1 33. The system of claim 31, wherein at least one of the bookmark media objects 

2 comprises an audio stream. 

1 34. The system of claim 3 1 , wherein at least one of the bookmark media obj ects 

2 comprises a video stream. 

1 35. The system of claim 31, wherein a client device configured to store references to the 

2 bookmark media objects on the web server. 

1 36. The system of claim 3 1 , wherein the web server is configured to update each 

2 bookmark media object as a function of a current state of the corresponding network 

3 destination. 

1 37. The system of claim 36, wherein the web server is configured to update each 

2 bookmark media object as a function of information received from the web browser. 

1 38. The system of claim 36, wherein the web server is configured to update each 

2 bookmark media object when content of the network destination is changed. 
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ABSTRACT OF THE DISCLOSURE 

A server within an online environment is configured to store a set of bookmark media 
objects that provide a multimedia preview of the destinations within the environment. The 
bookmark media objects can be graphic thumbnails of corresponding web pages, audio 
5 streams, video streams or any combination thereof or other suitable media that provides a 
representation of the destination. A client device is communicatively coupled to the server 
and is configured to store references to the network destinations and references to the 
corresponding bookmark media objects. A web browser executing in an operating 
environment provided by the client device is configured to retrieve and present the bookmark 
10 media objects to a user for selection. Based on the selection, the web browser accesses the 
corresponding network destination. Each bookmark media object is updated as a function of 
a current state of the corresponding network destination, user information or general 
conditions of the computing environment. 
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